#information theory

A course exploring the fundamental connections between physics, information theory, and computation.

A cautionary talk about the spread and misuse of information theory outside its proper domain. Famous for warning against overapplication.

A practical guide to implementing entropy calculation and data compression using Python.

Exploring the connections between information theory and the emerging field of machine learning. Published in the IRE Transactions.

Exploring the application of information theory to biological systems and genetics, pioneering the field of bioinformatics.

Extension of information theory to noisy channels, introducing the concept of error-correcting codes and proving it's possible to achieve reliable communication.

The foundational paper introducing information theory, entropy, and channel capacity. This paper fundamentally changed how we think about information.

The seminal paper that established information theory as a new field of study. Introduced the concept of entropy and channel capacity.